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(57) ABSTRACT 

A method and system for indicating the camera position, 
direction, and field of view in a map or panoramic image 
comprises a map image window which displays a map or 
panoramic image of the site to be studied (house, apartment, 
city, etc.). A detailed view window displays a portion of the 
map image, taken from a point in the site. A highlighted 
sector in the map image represents the viewing position, 
direction, and field of view that the detailed view window 
displays. When the user changes the field of view in the 
detailed view window, the highlighted sector in the map 
image changes in synchronism. The restilting interactive 
windows allow a person to easily and quickly view and 
understand the field of view, position, and direction of the 
image being displayed in the detail view window. 

28 Claims, 3 Drawing Sheets 

(3 of 3 Drawing Sheet(s) Filed in Color) 

Microfiche Appendix Included 
(1 Microfiche, 18 Pages) 



10 30 




40 



06/22/2004, EAST Version: 1.4.1 



U.S. Patent May 13, 2003 Sheet 1 of 3 



US 6,563,529 Bl 




06/22/2004, EAST Version: 1.4.1 



U.S. Patent May 13, 2003 Sheet 2 of 3 US 6,563,529 Bl 




30 




06/22/2004, EAST Version: 1.4.1 



U.S. Patent May 13, 2003 sheet 3 of 3 US 6,563,529 Bl 





06/22/2004, EAST Version: 1.4.1 



us 6,: 

1 

INTERACTIVE SYSTEM FOR DISPLAYING 
DETAILED VIEW AND DIRECTION IN 
PANORAMIC IMAGES 



MICROFICHE APPENDIX 

Included with this application is a single-fiche microfiche 
appendix of 18 frames, which contains the programs pmvr. 
Java (11 frames) and FloorPlan Java (7 frames); these imple- 
ment the present invention. 

COLOR DRAWINGS 

The file of this patent contains at least one drawing 
(photograph) executed in color. The Patent and Trademark 
Office will, upon request and payment of the necessary fee, 
provide copies of this patent with color drawings. 

RESERVATION OF COPYRIGHT 

A portion of this patent application contains material in 
which applicant claims copyright protection. Applicant has 
no objection to the reproduction by anyone of this apphca- 
tion or patent as it appears in the Patent and Trademark 
Office, but reserves all other rights whatsoever, including the 
right to reproduce and use the software programs included 
with such patent application. 

BACKGROUND 

1. Field of Invention 

This invention relates to viewing panoramic images, 
specifically to an improved method for displaying a detailed 
field of view and a direction when viewing panoramic 
images. 

2. Description of Prior Art 

Using panoramic images to present virtual (computer- 
simulated) tours of real physical environments is becoming 
commonplace. Many virtual tours use 360° panoramic 
images and employ a detail viewer. The viewer displays a 
portion of the panoramic image and provides a method for 
panning throughout the image. Panning is usually accom- 
plished by using a mouse or keyboard input device. 

A common viewer used to create these tours is sold by 
Apple Computer Corp. of Cupertino, Calif, under the trade- 
mark QUICKTIME VR. It provides a way to view pan- 
oramic images from a web site by using a web browser. 
Other companies provide services and software to create 
virtual tours for the real estate industry. E.g., such software 
is found under the trademark BAMBOO at the Internet site 
www.bamboo.com, and IPIX at www.ipix.com. 

While these systems provide tours that contain many 
detailed views of rooms, it is difficult to understand how all 
the views or rooms relate to each other and which direction 
the user is facing. E.g., if a prospective real estate purchaser 
takes a virtual tour of a house and goes to the living room, 
then the dining room, then the kitchen, etc., the software 
enables the prospect to visit these rooms in any order and to 
see them in detail. However it does not indicate how the 
rooms interrelate physically, in which direction the prospect 
is proceeding as they move through the house, and where the 
rooms are in relation to each other and in the overall scheme, 
i.e., the layout of the house. 

Thus, although these virtual tours have a good 
appearance, they do not help the individual to understand 
fully the field of view, direction, and relation of the detailed 
views to the overall layout because the tours display only 
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detailed views of panoramic images. Some web sites display 
panoramic images along with maps of the panoramic image, 
but the maps are static and are only used to select which 
image to view. I.e., the static map image does not help the 

5 individual to fully understand the field of view, direction, 
and relation to the overall layout. 

An architectural design software package, sold under the 
trademark CHIEF ARCHITECT at www.chiefarch.com, 
allows a user to in effect to place a virtual camera on a spot 

30 on a floor plan and have a window appear on the screen to 
indicate the camera's field of view in a map window. (Two 
short, fixed-length diverging lines on the floor plan indicate 
a sector seen by the camera and thus indicate the camera's 
field of view.) But if the user changes the field of view in this 

35 window by resizing it, moving controls bars, or using an 
"elevator** (a block in the vertical side column), the "cam- 
era's" orientation on the floor plan remains unchanged and 
will thereby become inaccurate. This program also has a 
reverse disadvantage: If the user moves the camera on the 

20 floor plan, the map window does not immediately change to 
reflect the new camera position or orientation until after the 
user clicks in the map window. Thus the display can be very 
misleading because the two windows (the detailed view and 
the map window) will often be out of synchronization 

25 (sync). 

OBJECTS AND ADVANTAGES 

Accordingly, several objects and advantages of my inven- 
tion are: 

(a) to provide an improved virtual image viewing and 
panning system, 

(b) to provide such a system in which part of a panoramic 
image is represented in a detailed image, the location of 
which is shown in an improved map image, 

(c) to provide a detail viewer in which a user will 
understand the field of view that is shown in this view 
and in which direction it is taken, 

(d) to provide such a viewer in which it is much easier for 
40 the user to understand direction without any prior 

knowledge of the physical location of the panoramic 
image, and 

(e) to provide such a viewer in which the detailed image 
and the map image are never be out of sync because any 

45 change in the detailed image is immediately reflected in 
the map image, and any change in the map image is 
immediately reflected in the detailed image. 
Other objects and advantages are: 

(f) to provide a viewer for viewing detail in a panoramic 
50 image in association with a map that shows the location 

of the detailed image in the panoramic image, 

(g) to provide such a viewer in which, when the detailed 
image changes, the map shows a highlight indicating 
this new detailed image, and 

(h) to provide such a viewer in which detailed image or 
field of view is highlighted or otherwise indicated to 
provide a frame of reference for those who have never 
physically been to the location. 

Further objects and advantages will become apparent 
from a consideration of the drawings and ensuing descrip- 
tion. 

DRAWINGS 

FIG. 1 (prior art) shows a computer linear display or 
65 photo of a full (360°) panoramic image of a shopping area, 
ready to be viewed with a detail viewer in accordance with 
the invention. 
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FIG. 2 (prior art) shows a similar photo of a detailed or 
enlarged view of a portion of the panoramic image of FIG. 
1. 

FIG. 3 depicts a window showing a map which includes 
the area covered by the panoramic image of FIG. 1, and one ^ 
method of indicating the area and direction of the detailed 
field of view of FIG. 2, in accordance with the invention. 

FIG. 4 shows a computer display window showing a 
presently preferred layout of a detailed view adjacent a map 
of the panoramic image of FIG. 1, with the detailed view 
taken from a different direction than FIG. 2 and the map 
indicating this different direction, in accordance with the 
invention. 

FIG. 5 depicts a window showing a detailed view of part 
of a room in the inside of a house in accordance with the 
invention, together with an adjacent map showing the loca- 
tion of the room in a floor plan of the house. 

FIG. 6 depicts a window showing a detailed view of a 
covered porch of the house of FIG. 5, together with an 20 
adjacent map showing the location of the porch in the house 
floor plan. 



25 



35 



REFERENCE NUMERALS 

10 compass rose 
30 dot representing camera 
32 field of view angle 
34 highlighted view area or arc 
36 new highlighted view area or arc 
38 new map 

40 new detailed field of view 
60 detailed view of Great Room 
62 map of floor plan incl. room 60 
64 highlighted sector in map 62 
66 detailed view of porch 
68 map of area incl. Porch 
70 highlighted sector in map 68 

SUMMARY 

40 

In accordance with the invention, I provide an improved 
method for showing a detailed field of view of a panoramic 
image and a map of the area covered by the panoramic 
image that indicates the direction and area over which the 
detailed field of view is taken. The detailed field of view is 
presented in one window and displays a portion of the 
panoramic image. The map is presented in another window 
and has a sector that is highlighted or contrasted from the 
rest of the map to indicate the point of origin and direction 
of the detailed image. When the user changes the field of 
view in the detailed field of view window, the highlighted 
sector changes accordingly. The resulting interactive win- 
dows allow a person easily and quickly to view and under- 
stand the field of view and direction of the image being 
displayed in the detailed field of view window. The pan- 
oramic image may be of an outside or inside area. 



Description — FIGS. 1 & 2 — Prior-art Panoramic & 
Detailed Views of Shopping Area 

Prior to describing the viewer of the invention, I will first 
describe a typical panoramic image and a detail view 
window and the problem with using these images, which is 
solved by the present viewer. 

FIG. 1 (prior art) shows a sample full (360**) panoramic 
image of an area, in this case a portion of a shopping area, 
Ruskin Place, in Seaside, Fla. it was taken with multiple 
successively rotated exposures using a digital camera to take 



a series of pictures and splicing the pictures together to form 
the 360° image, but it can also be taken with fewer exposures 
using a camera with a panoramic or 180° (or narrower) lens. 
Alternatively it can be taken with a plurahty of separate 
cameras operating simultaneously, each with a relatively 
narrow field of view, with their separate images electroni- 
cally spliced together to form the 360° composite image. 

The image of FIG. 1 is displayed in a linear window in a 
computer screen by a conventional image display program 
from a computer file formed by scanning the panoramic 
photo (not shown) or inputting an electronic file representing 
the image directly into the computer. The image of FIG. 1 is 
typically used in any of many ways, e.g., to orient a 
newcomer to an area, or to plan modifications to an area. The 
image of FIG. 1, being a fully clear 360° image, shows much 
more than can be seen by a htmian since a human's view 
angle is limited to about 140°, and of this, only about 30° to 
50° is clear or in focus. 

FIG. 2 (prior art) shows a detailed or close-up view of a 
center portion (about 80°) of the panoramic image of FIG. 

1. It can also be displayed on the same computer screen in 
a separate window by the same imaging program. Note that 
the detailed view of FIG. 2 is identical to a center portion of 
the panoramic image of FIG, 1, albeit enlarged. 

ITie detailed view of FIG. 2 is very useful since it shows 
the details of a portion of the panoramic image of FIG. 1. 
The portion shown in FIG. 2 is in the center of the panoramic 
image of FIG. 1, but if the user is interested in any other 
portion of the panoramic image, the detail view can be 
moved to view any other portion easily. E.g., if the user 
wants to see a detail of an area to the right of the center area 
shown in FIG. 2, they simply position the cursor of their 
mouse in FIG. 2. Then they depress and hold down the 
mouse button (usually the left button on a multiple -button 
mouse), and move or drag the cursor to the right. This will 
cause the portion of the panoramic image of FIG. 1 shown 
in FIG. 2 to change and move, just as if the user were 
actually standing and turning to the right. 

While the above views are useful, they do not show the 
user which portion of the panoramic image they are viewing 
and how the area viewed is changing. Thus to determine 
what portion of the panoramic image is being viewed, the 
user must locate the buildings or features shown in FIG. 2 
in FIG. 1. This may not be too difiScult with the simple and 
unique arrangement of buildings and features in FIGS. 1 and 

2, but can be very difficult with other areas, such as those 
which show flora, the inside of a building, etc. 

As stated, one system shows a map of the area with the 
detailed area indicated, but when the detailed area is 
changed, the indication on the map does not change unless 
special additional steps are taken. This is highly disadvan- 
tageous since it requires the user to take intermediate steps 
and interrupt their viewing and scanning. This causes the 
55 user to lose their orientation and severely limits their under- 
standing of the area. 

Description — FIG. 3 — Map Image & FIG. 4 — 
Combined Views of Shopping Area 

60 FIG. 3 shows a partial map of a town, which, in accor- 
dance with the invention, depicts a bird's-eye view 3f the 
area covered by the panoramic image of FIG. 1. I.e., it shows 
the buildings seen in FIG. 1, plus some additional surround- 
ing area not seen in the panoramic image of FIG, 1. The map 

65 image of FIG. 3 may also be displayed on the same computer 
screen in a separate window. It is displayed using an imaging 
program in the same manner as with the images of FIGS. 1 
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and 2. The map of FIG. 3 includes a compass rose or 
crosshairs 10 to show geographical directions. 

'Ilie position of the camera from which the panoramic 
image has been taken is represented by a dot 30, preferably 
in a contrasting color, such as yellow as shown. The camera 5 
indicated has a field of view or viewing angle of about 80**, 
generally in a South-Soulh-East (SSE) direction so as to 
view an area 34 of FIG. 3 covered by angle 32. Viewed area 
34 is highlighted (i.e., it is lighter than the rest of the map, 
which is made darker) to show visually the area of FIG, 1 
that FIG. 2 details. 

FIG. 4 is similar to FIGS. 2 and 3, except that it combines 
the two windows into one window with two sections, a left 
section 40 — the detailed field of view, and a right section 
38 — the map. The single widow of FIG. 4 is the presently 
preferred embodiment since, by combining both windows 
into one, is simpler in appearance. As will be explained, 
detailed field of view 40 shows a new area of the panoramic 
view of FIG. 1 slightly to the left of the view of FIG. 2, while 
map 38 shows a new highlighted view area 36, rotated 
slightly counter-clockwise (CCW) from view area 34 of 
FIG. 2. 

Basic Operation— FIGS. 1 to 4 

As indicated above, the user can change the field of view 
of FIG. 2. I.e., the user simply positions the cursor (not 
shown) of their mouse (not shown) anywhere in FIG. 2. 
ITien they depress and hold down the mouse button (usually 
the left button on a multiple -button mouse), and move or 
drag the cursor to the right or to the left. This will cause the 
portion of the panoramic image of FIG. 1 shown in FIG. 2 
to change and move, just as if the user actually stood at 
location 30 and turned to the right or left. 

When the user changes the field of view of FIG. 2 in this 
manner, the highlighted sector or arc displayed in the map 
(FIG. 3) simultaneously rotates and always shows the actual 
sector displayed in FIG. 2. 

E.g., assume that the user positions the cursor anywhere 
in FIG. 2 to the left of the right border and drags the cursor 
slightly to the left. FIG. 2 will change as follows: the image 
will move to the right as the cursor is moved to the left so 
as to display an area to the left of the center area of FIG. 1, 
as shown by new detailed view window 40 in FIG. 4. 

The detailed view will change in the same manner as if a 45 
person standing at location 30 in FIG, 3 and looking in the 
SSE direction to see field of view 34 of FIG. 3 turned their 
head slightly to the left. The person would then view in the 
generaUy ESE direction as shown by field of view 36 in map 
38 at the right-hand side of FIG. 4. 50 

Simultaneously highlighted sector or arc 34 of FIG. 3 will 
rotate CCW to highlight new field 36 in FIG. 4 and the actual 
area being viewed. The highlighted area will still cover an 
angle or arc 32, which will be approximately 80°, but may 
change slightly because of imperfections in the images. Thus 55 
when the viewed arc is moved, one of the lines bounding the 
highlighted arc may move faster or slower than the other line 
to reflect this. 

As stated, movement of the field of view can be effected 
by dragging the cursor in the detailed view of FIG. 2, or in 60 
the detailed view window 40 of FIG. 4, Movement of the 
field of view can also be effected by clicking and dragging 
the cursor in the map of FIG. 3 or map window 38 of FIG. 
4. I.e., the user would position the cm-sor anywhere in the 
map of FIG. 3, or anywhere io map window 38 of FIG. 4. 65 
The user left clicks and holds down the mouse button and 
drags the cursor approximately clockwise (CW) or CCW. 
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The highlighted arc will rotate in the selected direction. E.g., 
if the highlighted sector is looking in the SSE direction as 
shown in FIG, 3 and the cursor is cragged up or CCW, the 
highlighted arc will move slightly CCW, as shown by arc 36 
in image 38 of FIG. 4. Thus the field of view can be changed 
by clicking and dragging in either the map or the detailed 
field of view window. 

In FIG. 4, detail view window 40 is positioned adjacent 
and joined to map 38. As stated, this is the presently 
preferred arrangement, but the arrangement of FIGS. 2 and 
3, where the windows are separated, will also operate in an 
identical manner. 

Thus whenever the user changes the field of view in FIG. 

2 (or window 40 of FIG, 4) in either direction, the high- 
lighted sector or view shown in FIG. 3 (or window 38 of 
FIG. 4) will automatically and simultaneously change to 
show the new field of view. This will enable to user to 
always see exactly what part of the panoramic image they 
are viewing. The user will obtain a much better understand- 
ing of the field of view and direction, and hence of the area 
being viewed. 

The above example can be experienced interactively 
online at the following site: 

http://www.duckware.com/patent.hlml. 

Relocation of Camera — FIGS. 1 to 4 

In addition to showing a panoramic map of the geographi- 
cal area and a detailed view of any selected portion of the 
area in another window, the program can be used to move 
the map as if the camera were moved to another location. 
The map will change accordingly to show a new map of the 
area, as seen from the new camera location, with the camera 
location being located in the approximate center of the new 
map. 

In the example shown in the above site, the camera's 
position can be moved to inside a building and the detailed 
view (FIG. 2 or 40 in FIG. 4) will show the room and the 
map (FIG. 3 or 38 in FIG. 4) will show a map of the room. 
The detailed view will change to reflect the new camera 
location and can be moved throughout the new map as 
before, 'Ilie above programs (in microfiche in the file of this 
patent) will effect this operation. This is illustrated in FIG. 

3 by new camera location 30', which has been moved from 
original camera location 30 by the arrow coimecting original 
location 30 with new location 30'. 

Automatic Panning — ^FIGS. 1 to 4 

The manual movement of the detailed view discussed 
above under Basic Operation can be done automaticaUy 
within the program. This automatic panning is configured by 
the designer of the HTML page containing the detailed pmvr 
viewer by inserting the following line into the param section 
of the pmvr applet (section of the HTML document): 

<param name="auto" value="l"> 

For example, an automatic panning capability can be 
added to the test.html document described below by insert- 
ing this single line just after the "pixdeg" line. 

When automatic panning occurs, field-of-view sector 32 
will rotate around slowly in either direction, as indicated by 
arrows 32' in FIG. 3. During this movement, the detailed 
view (FIG. 2 or 40 in FIG. 4) will automatically pan in a 
corresponding movement. This movement can be seen at the 
above duckware site. The manual panning operation can still 
be used and will override the automatic panning operation. 

Method of Installing and Using System — FIGS. 1 
to 4 

To install and use the system, a programmer need merely 
install the above two source programs (pmvr.java and 
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FloorPlan.java) into a working directory on any computer due north (90) and that the rightmost pixel (2000) of the 

having the following installed programs: (1) a Java compiler panoramic image is also pointing due north (90). 

(to translate the Java source code into Java class files), and Within the second FloorPlan applet, the 'height' (250) is 

(2) a Java-enabled web browser. set to be the same as the pmvr applet, since they will usually 

Then the Java source files are compiled into Java -class 5 be seen side by side next to each other, 

files. This is done by using a program, Java Development Kit The 'width' (200) is set to be the pixel width of the map 

(JDK), sold by Sun Microsystems, and issuing the following image, 

commands: The 'image' par am value must be set to the file name of 

javac pmvr.java saved map image, which will be 'map.gif*. 

javac FloorPlan.java ^^^^ ^^^^^ P^*"^™ ^^^^^ specify the x and 

After these commands are run, the current working direc- ^ P^^^ locations within the map image that represents the 

tory will contain the compHed programs. Namely, pmvr.java ^^^"^1"^ ^^^^^'^S position (camera location) of the pan- 

will be compiled and produce a file named pmvr.class, and ^'^^^^ image. ^t^^^ , 

n ™ • 11 u 1 J J J £1 J Ine imal step is to view the test HI ML document, 

FloorPlan.java will be compiled and produce a file named . . i , . 

FloorPlan class '^^ test.html, within a Java enabled web browser. 

-nien a 360° panoramic image, such as the one of HG. 1. t,"^^"^ '° ^f,*' 

is installed on the computer's hard disk in the working provided the panoramic image otTlGA and the map of FIG. 

directory under the name panoramic.jpg. in JPEG format. ^ ^ff^" The interactive operation between the map unage 

Next a map image, such as the one in FIG. 3, is installed ''^ '"^l^^'f ^'^^ ^-l' °P.«ra'<=.« described above^ 

on the computer's hard disk in the working directory under ^° , Alternatively the appletviewer program withm Suns 

the name map.gif, in GIF format. This map image is {^"^ Development Kit can be used to view the test.html 

produced using a drawing program, such as that sold under document. For example, running the comtnand 'applet- 

the trademark MICROSOFr PAINT by Microsoft Corp. of viewer test.html results in two windows similar to FIGS. 2 

BeUevue, Wash., from a map of the actual site shown in the and 3 bemg displayed. .,„„,,^^ 

panoramic image. E.g.. an achial map is scanned with a " '"'^'i''^'' °^ 

scanner and opened with the drawing program. The resulting P^^vr-java and Imes 147-157 and 267-272 of FloorPlan.java 

image is changed using the drawing program to eliminate generally constitute synchronization means TTiis means 

any extraneous information and to provide the desired ^^anges the portion of the panoramic image highlighted in 

colors. Alternatively the map can be drawn by hand. The "'^ '° 'J'^S^., ^ P""'"" ""^ 

image is saved in GIF format under the name map.gif. (The '° Panoramic image shown m tie detailed view, and vice-versa, 

actual names of the images are not important, but they must , ^""^ f pmvr.java generally constitute means 

match the names used within the test.html document to be a^'omaticaUy changing the field of view at a predeter- 

created next) ^^^^ interval. 

Hie next step is to create an HTML document that uses , Lines 417-433 of pmvr.java generaUy constitute means 

u^*u 1 ^ CI ni 1 * • *u • 35 for enabling an operator to end such automatic changing, 

both pmvr.class and rloorPlan.class to view the panoramic & f fe fe 

image and the map within a Java-enabled web browser. For r>¥/^o « o ^ wr j en u* n m 

^ t * , iT-rm^T J . J. u FIGS. 5 & 6 — ^Wmdows of Building Floor Plan 

example, the user creates an HTML document named test.h- , „ ^ 

^ , r 11 and Rooms 
tml as follows: 

<html> The program can also be used to move through the rooms 

<body> ^ ^ building. In this case the detailed view will show 

<applet code=pmvr.class height=250 width=400> individual rooms and the map wUl show where the viewed 

„. „ , „ . • „ room is m the overall floor plan, 

<param name= image value = panoramic.jpg > ^ 

^-.r^™ "..j^^r'' «a/:fv»^ FIG. 5 shows a computer screen window containing on its 

<param name= vieV value= 36a > i a j j * -i j • r r 

u • A » 1 «rt r,rt ^ryrsr^ f^rx» 4< left Side 3 detailed view 60 of a portion of a Great Room 

<param namc="pixdeg" value="0«90,2000=>90"> 45 , c . • c ^ r-i ^ 

ft of a pnvate Gulf-front residence m Seaside, Fla. The 

PP ^ detailed view shows a sector or arc, approximately 80** wide, 

<applet name=noorPlan code=FloorPlan .class height= of a 360° panoramic image (not shown). An adjacent map 62 

250 width «200> ^jgfjj ^^^^ q£ window shows a floor plan with a 

<param name="image" value="map.gif' > highlighted sector 64 representing the area of view in 

<param name="x" value«"50"> detailed view 60. 

<param name«"y" value="100"> when a mouse is moved within detailed view 60, the 

</applet> shape of the mouse cursor normally will be an arrow, but 

</body> will change to a hand when the cursor is in a location where 

</html> 55 clicking will result in moving to a new room or location. For 

Within the first pmvr applet (third line above) the 'height' example, when the mouse cursor is moved to over a door to 

(250) is usually set to be the height in pixels of the sample the left or right of the windows in the center of detailed view 

panoramic image. The 'width* (400) is usually set to around 60, it will change to a hand. Clicking on either door will 

20% the width of the panoramic image (2000, for example). cause the window of FIG. 5 to change to the window of FIG. 

Thus the applet presents a partial view of the panoramic. 60 ^■ 

The 'image' param value (next fine above) is set to the file FIG. 6 depicts a widow showing a detailed view 66 and 

name of the saved panoramic image, which will be 'pan- adjacent floor plan map 68 of a covered porch that is 

oramic.jpg'. adjacent to the Great Room of FIG. 5. Note that map 68 of 

The 'view* param value is set to '360* to indicate that the FIG. 6 differs from map 62 of FIG. 5 in that map 68 is moved 

panoramic represents 360° of view. 65 just outside the room to show the adjacent porch. In map 68, 

The 'pixdeg* value is set to '0=90,2000-90' to indicate a sector 70 is highlighted to indicate the area of the porch in 

that the leftmost pixel (0) of the panoramic image is pointing detailed view 66. 
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In addition to clicking on areas within a detailed view to 
move from one area to another area, it is also possible to 
click within areas on the map to move from area to area. For 
example, moving the mouse cursor over the 'Great Room' 
text in map 68 of FIG. 6 will result in the mouse cursor 5 
changing to a hand cursor. Clicking on the 'Great Room* text 
will result in the window of FIG. 5 being re -displayed. 

The method of storing the map and detailed views of 
FIGS. 5 and 6 in the computer is similar to that of providing 
the images of FIGS. 1 to 4, discussed above when creating 10 
test.html, with the following exceptions: 

(a) For FIG. 5, both 'image' params are set to view the 
new panoramic and map images; the 'height* is set to 
'304*, 'pixdeg* is set to ' 0-102,750-0,1063 «320, 
1200-301,2400=102*; 'x* is set to '102*; and 'y* is set 
to '181 *. 

(b) For FIG. 6, both 'image* params are set to view the 
new panoramic and map images; the 'height is set to 
'300*; 'pixdeg* is set to '0=5,1137«175*; 'x* is set to 
'100*; and 'y* is set to '347*. 

The above examples can be experienced interactively 
online at the above duckware site. 

CONCLUSION, RAMIFICATIONS, AND SCOPE 

25 

Hius the reader will see that I have provided an improved 
detail viewer for a panoramic image that can be used to view 
any part of the image by simply moving it across the image. 
While the image is viewed, a map of the area covered by the 
panoramic image is displayed with the detailed field of view 30 
highlighted. When the detailed field of view is changed, the 
highlighted area in the map simultaneously changes to show 
the area being viewed. This enables the user to be more 
easily acclimated to and understand an area being viewed 
and also to understand more fully the direction in which the 35 
detailed view is taken. ITie user can do this v^dthout any prior 
knowledge of the physical location of the panoramic image. 
The map and the detailed field of view are never out of sync 
because a change in the map is immediately reflected in the 
detailed view and a change in the detailed view is immedi- 40 
ately reflected within the map. The map substantially 
includes the panoramic image area and has a highlight that 
always indicates the field of view and changes to the latter. 
This gives the user an excellent frame of reference that is 
highly useful if they have never physically been to the 45 
location before. The system can be used to view any type of 
area, inside or outside, or even celestial. 

While the above description contains many specificities, 
these should not be construed as limitations on the scope of 
the invention, but rather as an exemplification of one pre- so 
ferred embodiment thereof. Many other variations are pos- 
sible. For example, the panoramic image can be from a live 
video source and not just a static image. The map image can 
be generated from a geographic information system and not 
just a static image. As shown, the "highlighted*' area of the 55 
map is actuaUy made by darkening the rest of the map, but 
the detailed view area can be highlighted by making it 
lighter, in a different color, with darker lines, with border 
lines only, by shading, etc. The view can be changed by 
other than a mouse, e.g., by use of elevators in the side 60 
margins of the window of said detailed field of view, by 
keyboard commands, by voiced commands, by head or foot 
movements, etc. Instead of the geographic urban image 
shown, the images can be of a rural or natural area, in the 
inside or outside of a building. In the case of an inside- 65 
buUding image, it can be of a furnished or empty home, an 
apartment, etc. The viewer can be used on any type of image 
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displayer, including CRT monitors, flat screen displays, 
mosaic displays, projection displays, mobile or vehicle 
displays (the map would be of an actual large geographic 
territory), interactive television displays, laptop, desktop, or 
mainframe computers, dedicated computers, dumb terminals 
or clients with the software in a server, etc. 

Accordingly, the scope of the invention should be deter- 
mined not by the embodiments illustrated, but by the 
appended claims and their legal equivalents. 

I claim: 

1. A method for displaying a detailed view of an area 
within a territory, taken from a predetermined location 
within said territory, and indicating the area and direction in 
which said detailed view is taken from within said territory, 
comprising: 

providing a display that can display a map of a territory 
and a detailed view of an area within said territory, said 
detailed view being taken from a predetermined loca- 
tion within said territory, 
displaying said map of said territory on said display, 
displaying said detailed view, as taken from said prede- 
termined location within said territory, as an image on 
said display, 

providing an input means for a human operator to change 
the angular direction and area of said detailed view as 
seen from said location within said territory, 

using said input means to change said angular direction 
and said area of said detailed view, thereby to move 
virtually through said territory, 

indicating on said map said angular direction and said 
area of said detailed view, thereby providing, on said 
map, an indication of said angular direction and said 
area of said detailed view as seen from said location 
within said territory, 

causing any change in said angular direction and said area 
of said detailed view to be simultaneously indicated by 
a corresponding change in said indication on said map, 
such that both said detailed view and said indication on 
said map change substantially simultaneously, 

thereby to create a highly interactive display, which 
allows a human operator to better understand, by look- 
ing at said map, the area and direction of said detailed 
view. 

2. The method of claim 1 wherein said indicating on said 
map is done by causing said detailed view on said map to 
have a different brightness than the rest of said map. 

3. The method of claim 2 wherein said rest of said map is 
darkened relative to said detailed view so that said detailed 
view is effectively highlighted. 

4. The method of claim 1 wherein said change of angular 
direction or area of said detailed view is effected by manipu- 
lating the image of said detailed view. 

5. The method of claim 1 wherein said change of angular 
direction or area of said detailed view is effected by manipu- 
lating said detailed view image on said map. 

6. The method of claim 1 wherein said map of said 
territory is a geographical image, 

7. The method of claim 1 wherein said map of said 
territory is an image of the inside of a building. 

8. The method of claim 2 wherein said map and said 
detailed field are selectively arranged to change direction 
automatically and continuously. 

9. The method of claim 1 wherein said input means for a 
human operator to change the angular direction and area of 
said detailed view is also arranged to change said location 
from where said detailed view is taken, said input means is 
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used to change said augural direction and origin of said 
detailed view, and said map and said detailed view image are 
arranged to indicate any changes in angular direction and 
origin of said detailed view. 

10. A system for indicating the origin, area, and angular 5 
direction of a detailed view of an area within a territory, as 
seen from a point within said territory, and for also indicat- 
ing changes in said origin, area, and angular direction, 
comprising: 

detail display means for displaying a detailed view of an 
area within a territory, as seen from a point within said 
territory, and for enabling a user to change the origin, 
area, and angular direction of said area shown in said 
detailed view, 

map display means for displaying a map of said territory 
and indicating the origin, area, and angular direction of 
said area within said territory, as shown in said detailed 
view, and 

synchronization means for changing, in said map, the 
origin, area, and angular direction of said territory 
shown in said detailed view, said changing occurring in 
response to and in correspondence with changes in the 
origin, area, and angular direction of said territory 
shown in said detailed view, or for changing said 
detailed view in response to and in correspondence 
with changes in the origin, area, and angular direction 
of said detailed view of said area of said territory shown 
in said map. 

11. The system of claim 10 wherein said map display 
means is arranged to indicate the area of said territory shown 
in said detailed view in a different brightness than the rest of 
said map. 

12. The system of claim 11 wherein said map display 
means is arranged to darken the rest of said image relative 
to said area so that said area is effectively highlighted. 

13. The system of claim 10 wherein said synchronization 
means is responsive to manipulations of said detailed view. 

14. The system of claim 10 wherein said synchronization 
means is responsive to manipulations of said area in said 
detailed view. 

15. The system of claim 10 wherein said map is an image 
of a territory selected from the group consisting of geo- 
graphic and inside-building images. 

16. The system of claim 10 wherein said synchronization 
means is arranged to change direction and field of view of 
said map and said detailed view automatically and continu- 
ously. 

17. A system for indicating the origin, area, and angular 
direction of a detailed view of an area within a territory, and 
for also indicating changes in said origin, area, and angular 
direction, as seen from a point within said territory, com- 
prising: 

a display for displaying a detailed view of an area of a 
territory, as seen from a point within said territory, and 55 
for enabling a user to change the origin, area, and 
angular direction of said area within said territory, as 
shown in said detailed view, 

map display means for displaying a map of said territory 
and indicating the origin, area, and angular direction 60 
said area of said territory shown by said detailed view, 
and 

a synchronizer for changing, in said map, the origin, area, 
and angular direction of said area of said area within 
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said territory shown in said detailed view in response to 
and in correspondence with changes in said origin, 
area, and angular direction of said territory shown in 
said detailed view. 

18. The system of claim 17 wherein said map display 
means is arranged to indicate the portion of said territory 
shown in said detailed view in a different brightness than the 
rest of said map, 

19. The system of claim 18 wherein said map display 
means is arranged to darken the rest of said image relative 
to said field of view so that said the field of view is 
effectively highlighted. 

20. The system of claim 17 further including: 

a timer for automatically changing said field of view at a 

predetermined interval, and 
a timer stop for enabling an operator to end said automatic 

changing of said field of view. 

21. The system of claim 17 wherein said territory repre- 
sents a room in a building and said map image is a floor plan 
of said building. 

22. The system of claim 17 wherein said territory repre- 
sents a part of a geographical area and said map represents 
said geographical area. 

23. A system for indicating the origin and area of a 
detailed view of an area within in a territory, as seen from a 
point within said territory, comprising: 

a display for displaying a detafled view of an area within 
a territory as seen from a point within said territory, and 
for enabling a user to change the location of said point, 
said area, and the angular direction of said area as seen 
from said point, as shown in said detailed view, 

a map display for displaying a map of said territory and 
indicating said point, said area, and said angular direc- 
tion of said area as seen from said point, as shown in 
said detailed view, and 

a synchronizer for changing, in said map, said point, said 
area, and said angular direction of said area within said 
territory indicated by said detailed view in response to 
and in correspondence with changes in said point 
origin, said area, or said angular direction as shown in 
said detailed view. 

24. The system of claim 23 wherein said map display is 
arranged to indicate said area of said territory shown in said 
detailed view in a different brightness than the rest of said 
map. 

25. The system of claim 24 wherein said map display is 
arranged to darken the rest of said image relative to said area 
of said territory so that said area is effectively highlighted. 

26. llie system of claim 23 further including: 

a module for automatically changing said area at a pre- 
determined interval, and 

a module for enabling an operator to end said automatic 
changing of said area. 

27. The system of claim 23 wherein said territory repre- 
sents a plan of a floor of a building and said detailed view 
shows a room on said floor of said building. 

28. The system of claim 23 wherein said territory repre- 
sents a geographical area and said detailed view shows a 
sector of said geographical area. 

***** 
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